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LONG-TERM  GOALS 

The  long  term  goal  of  this  interdisciplinary  research  program  continues  to  be  the  demonstration  of 
Bayesian  Hierarchical  Model  (BHM)  utility  in  several  aspects  of  operational  ocean  forecasting. 

The  specific  goals  in  the  current  phase  of  the  research  are:  1)  publications  of  results  from  ensemble 
ocean  forecast  experiments  driven  by  the  surface  vector  wind  (SVW)  BHM;  b)  consolidating  impacts 
results  in  MES  reforecast  experiments  for  the  time-dependent  error-covariance  BHM;  and  c)  running 
the  first  multi-model  and  multi-parameter  super-ensemble  BHM  experiments. 

OBJECTIVES 

Research  objectives  leading  to  the  publication  of  manuscripts  regarding  SVW-BHM  include: 
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1)  constructing  3  appendices  for  Milliff  et  al  (2009)  to;  a)  demonstrate  a  systematie  approaeh  to 
(future)  process  model  development;  b)  document,  in  probability  model  notation,  the  complete 
SVW-BHM,  as  well  as  expressions  for  the  full  eonditional  distributions;  and  c)  doeument  the 
SVW-BHM  hyperprior  speeifioations; 

2)  Re-writing  the  text  and  updating  figures  for  Bonazzi  et  al.  (2009);  and 

3)  ineorporating  eo-author  final  edits  for  Milliff  et  al.  (2009)  and  Bonazzi  et  al.  (2009). 


Researeh  objeetives  leading  to  eonsolidation  of  results  for  the  time-dependent  error-eovarianee  BHM 
include: 

1)  supplying  an  anomaly-only  data  stage  version  of  the  error-eovariance  BHM  to  MFS  for 
reforecast  experiments;  and 

2)  interpreting  reforecast  results,  and  iterating  with  MFS  for  future  reforeeast  experimental  design. 


Researeh  objeetives  leading  to  the  first  multi-model  and  multi-parameter  super-ensemble  BHM  runs 
include: 

1)  evaluating  preliminary  experiments  based  on  a  Levantine  Intermediate  Water  (LIW)  formation 
rate  target  process; 

2)  re-organizing  the  target  process  to  focus  on  temperature  (7)  and  salinity  (S)  profile  evolution 
at  2  locations  in  the  region  of  LIW  formation  (Rhodes  Gyre);  and 

3)  providing  T(z,t)  and  S(z,t)  data  files  (.mat)  to  Mark  Berliner  for  preliminary  modelling. 


APPROACH 

Appendices  and  updates  for  the  BHM-SVW  papers: 

The  sample  BHM  model  equation  and  the  expression  for  the  full  eonditional  distribution  for  the  zonal 
wind  eomponent  Ut  are  provided  here,  where  u  is  an  n-vector,  spanning  all  n  loeations  on  the  target 
grid.  The  process  model  form  (derived  from  the  Rayleigh  Friction  Equations)  is: 

~  N{ai_\I)yPt  -F  ai,2/^TP<  -F  VV7i“,cr„I) 


where  there  are  terms  in  the  Normal  distribution  specification  (right  hand  side)  for  pressure  gradient 
effects  and  a  scale-selective  nested  wavelet  summation  that  proved  useful  in  a  process  model  for 
tropieal  winds  in  Wikle  et  al.  (2001).  In  keeping  with  a  key  advantage  of  BHM,  the  uncertainty  in  the 
zonal  wind  distribution  is  modeled  in  the  variance-covariance  term.  If  we  let  Hu  =  a  ijDy  +  a  i2Dx 
then  the  full  conditional  distribution  is: 
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As  noted  above,  this  can  be  shown  to  be  a  Gaussian  Distribution  Ut  \  ■  '^(Ab,A),  where 
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Expressions  of  these  forms  for  data  stage  and  process  model  terms,  and  the  implied  full  conditional 
distributions  of  BHM-SVW  are  included  in  Appendix  2  of  Milliff  et  al.  (2009).  The  hyperpriors  for 
terms  that  are  specified  (i.e.  rather  than  endowed  with  distributions)  in  the  full  conditional  distributions 
are  included  in  Appendix  3. 

The  companion  paper,  Bonazzi  et  al.  (2009)  was  updated  and  re-written  by  Prof.  Nadia  Pinardi  during 
her  annual  summer  visit  to  Boulder,  CO  (CoRA  offices)  this  August.  Both  papers  are  undergoing  final 
edits  by  co-authors  before  submission  for  publication  this  month. 

Iterating  Time-Dependent  Error  Covariance  BHM  based  on  impacts: 

A  new  round  of  reforecast  experiments  for  the  Gulf  of  Lyon  region  (MFS  region  3)  have  been  run  to 
test  time-dependent  error  covariance  matrices  that  are  the  posterior  means  of  the  Error-Covariance 
BHM.  Earler  experiments  based  on  a  version  of  the  time-dependent  error  covariance  BHM  using  the 
quality  controlled  misfit  d  and  anomaly  q  data  provided  by  MFS  did  not  lead  to  significant 
improvements  in  comparisons  with  Argo  data.  The  comparisons  were  noisy,  suggesting  that  very 
localized  and  short  timescale  variability  was  influencing  the  time-dependent  error  covariance  in  ways 
that  were  not  useful  to  the  forecast  system. 

The  new  version  of  the  error  covariance  BHM  uses  only  q  information  in  the  data  stage.  The  q  inputs 
are  more  smoothly  varying  in  time  than  d,  and  they  exhibit  a  clear  seasonal  cycle.  Time  series  of  error 
covariance  matrices  were  provided  to  MFS  for  ""q-only”  reforecast  experiments. 

Identifying  T(z,t),  S(z,t)  Target  Processes  for  the  Super-Ensemble  BHM 

The  LIW  formation  rate  time  series  from  analysis  (SYS3a2)  and  simulations  from  two  MFS  ocean 
models  (OPA  and  NEMO)  did  not  lead  to  informative  posterior  distributions  in  preliminary 
experiments  with  the  super-ensemble  BHM,  as  designed  and  run  by  Prof  Mark  Berliner  (i.e.  as  in 
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Berliner  and  Kim,  2008).  There  are  ambiguities  in  the  definition  of  LIW,  and  the  model  proeesses 
leading  to  formation,  that  are  larger  than  the  signal  and/or  model  biases.  As  sueh,  the  super-ensemble 
BHM  posteriors  were  dominated  by  the  model  uneertainties. 

During  Prof.  Nadia  Pinardi's  visit  to  CoRA  in  August,  she,  Berliner  and  Milliff  worked  with  Dr. 
Jeremiah  Brown  (NWRA/CoRA)  to  identify  two  loeations  in  the  Rhodes  Gyre  region  where  time 
series  of  T  and  S  profiles  from  SYS3a2,  OPA  and  NEMO  eould  be  used  as  a  new  target  proeess  for  the 
super-ensemble  BHM.  Time  series  of  T(z,t)  and  S(z,t)  have  been  provided  to  Prof  Berliner  in 
preparation  for  new  super-ensemble  BHM  experiments.  The  thinking  is  that  inherent  uneertainties  in 
simulations  and  analysis  of  T(z,t)  and  S(z,t)  will  not  be  large  enough  to  dominate  posterior  distributions 
in  the  new  experiments  to  be  run  this  month. 

WORK  COMPLETED  AND  RESULTS 

Researeh  program  progress  and  plans  were  reviewed  for  ONR  program  managers  in  a  presentation  by 
Milliff  at  the  ONR  PI  Meeting  in  Chieago  in  June  2009. 

Publishing  BHM-SVW  development  and  forecast  impacts 

The  eareful  produetion  of  the  BHM-SVW  equations  and  expressions  for  full  eonditional  distributions, 
and  the  presentation  of  hyperprior  speeifieations,  are  essential  steps  in  preparing  BHM-SVW  for 
teehnology  transfer  to  operational  oeean  foreeast  applieations  at  MFS  and  elsewhere  (e.g.  NRL  SSC 
Oeean  Modeling  Group).  Together,  these  appendiees  eomprise  the  neeessary  information  to  eonstruet 
(and  adapt  as  needed)  the  BHM-SVW  used  in  our  demonstration  projeet  with  MFS. 

Bonazzi  et  al.  (2009)  demonstrates  impaets  on  MFS  foreeasts  of  uneertainty  quantifieation  based  on 
realistie  spread  in  surfaee  wind  foreing  from  BHM-SVW.  Figure  1  provides  a  pietorial  sense  of  the 
enhaneed  spread  in  oeean  model  response.  The  left  hand  panels  depiets  the  SSH  field  at  day  10  of 
oeean  foreeasts  (i.e.  day  lOF)  driven  by  members  of  the  ECMWF  ensemble  foreeast  winds,  and  the 
right  hand  panel  depiets  the  SSH  fields  on  lOF  as  foreed  by  3  realizations  of  BHM-SVW.  Superposed 
on  eaeh  SSH  field  are  6  trajeetories  from  idealized  drifters  released  in  eaeh  foreeast  at  day  IF.  The 
mesoseale  response  in  the  BHM-SVW  ease  exhibits  greater  spread,  as  do  the  simulated  trajeetories. 
Ensemble  spreads  from  traditional  methodologies  notoriously  under-estimate  uneertainties  and  often 
do  not  exhibit  realistie  variability.  This  failing  is  apparently  obviated  by  BHM-SVW.  Quantifieation 
of  this  improvement  is  doeumented  in  Bonazzi  et  al  (2009). 
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a)  ECMWF  1 


b)  BHM  1 


c)  ECMWF  2  d)  BHM  2 


e)  ECMWF  3  f)  BHM  3 
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Figure  1.  Sea-surface  height  anomaly  at  day  10  of  ensemble  ocean  forecasts  driven  by  (left) 
members  of  the  ECMWF  ensemble  forecast  winds  and  (right)  members  of  the  BHM-SVW  posterior 
distribution.  Color  contours  indicate  SSH  in  cm,  and  black  curves  mark  the  trajectories  of  6 
idealized  drifters  released  in  the  forecast  fields  at  the  forecast  initial  time.  SSH  variability  on 
mesoscales,  and  spread  in  the  trajectories  are  larger  in  the  BHM-SVW  ensemble.  These  results  are 
quantified  in  Bonazzi  et  al.  (2009).  They  are  consistent  with  the  localization  and  mesoscale  focus  in 
ocean  forecast  initial  conditions  documented  in  Milliff  et  al.  (2009). 

Impacts  of  the  q-only  time-dependent  error  covariance  BHM 

Figure  2  depicts  a  comparison  of  root-mean  square  differences  in  sea-level  anomaly  (SLA)  with 
respect  to  an  operational  merged  sea-level  product  based  on  altimeter  data.  Three  forecast  experiments 
are  compared  in  MFS  region  3,  covering  the  same  period,  differing  only  in  the  form  of  the  error 
covariance  matrix  used  in  the  data  assimilation  step.  The  green  line  represents  the  operational  system 
wherein  the  error  covariance  matrix  is  fixed  in  time.  The  black  line  is  for  a  reforecast  using  time- 
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dependent  error  eovarianee  matriees  from  the  BHM  based  on  both  d  and  q  data  stages,  and  the  yellow 
line  is  for  the  reeent  q-only  experiments.  Surprisingly,  time-dependent  error  eovarianee  does  not  seem 
to  improve  the  eomparisons  with  SLA  in  either  ease.  Further  analyses  (not  shown)  demonstrate  that 
mueh  of  the  uneertainty  in  SLA  is  eoming  from  the  error  eovarianees  for  salinity  (i.e.  as  opposed  to 
temperature).  New  designs  for  the  error  eovarianee  BFIM  are  being  designed  with  these  findings  in 
mind. 


RMS  misfits  SLA,  green  -  static,  black  -  dynamic,  yellow  -  new  dynamic 


Figure  2.  Sea-level  anomaly  (SLA)  root-mean-square  differences  with  respect  to  an  operational 
satellite  merged  product  for  MFS  model  grid  points  in  region  3  (Gulf  of  Lyon)  for  the  period  March- 
May  2005.  Three  reforecast  experiments  were  run  over  the  period,  varying  only  the  form  of  the 
error  covariance  matrix  used  in  the  data  assimilation.  The  green  line  represents  the  operational 
system  wherein  the  error  covariance  matrix  is  fixed  in  time.  The  black  line  represents  a  time- 
dependent  error  covariance  that  is  the  posterior  mean  output  of  the  error  covariance  BHM  based  on 
misfit  (d)  data  and  anomaly  (q)  data.  The  yellow  line  corresponds  to  time-dependent  error 
covariances  from  the  BHM  based  on  only  the  q  data.  The  q-only  reforecast  experiment  only  ran  to  1 

May  2005. 


Target  field  for  the  super-ensemble  BHM 

Figure  3  shows  sample  T(z,t)  summaries  for  a  point  on  the  southwestern  flank  of  the  Rhodes  Gyre  in 
the  Eastern  Mediterranean  Sea.  The  summary  period  shown  runs  from  1  February  through  3 1  Mareh 
2007.  T(z,t)  and  S(z,t)  summaries  for  two  points  (the  other  loeation  is  on  the  northeastern  flank  of  the 
Rhodes  Gyre)  have  been  ereated  from  the  analysis  (1  realization  for  eaeh  loeation)  and  from  1 1 
simulations  eaeh  of  the  OPA  and  NEMO  development  models  at  MES.  The  OPA  and  NEMO 
simulations  are  forced  by  the  ECMWF  analysis  and  10  realizations  of  the  BHM-SVW.  Similar 
summaries  are  provided  for  the  same  months  in  2005  and  2006.  The  super-ensemble  BHM  will  be 
used  to  hindcast  the  2008  T(z,t)  and  S(z,t)  summaries. 
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2007  SYS3a2TerTperature  (*C)—  33.5N , 2e.e75E 


2007  OPA  Terrpeiature  (C)  —  H  un  10  tot  33.6N.  26.€75E 


Time  (days)  Time  (days) 


Figure  3.  T(z,t)  for  a  point  at  26.875°E,  33.5°N  (Le.  on  the  southwestern  flank  of  the  Rhodes  Gyre) 
for  the  period  1  February  through  31  March  2007.  The  left  hand  panel  depicts  T(z,t)  from  the  MFS 
analysis  (SYS3a2)  and  the  right  hand  panel  is  from  an  OPA  model  simulation  driven  by  one 
realization  from  BHM-SVW.  An  intermediate  water  formation  event  is  evident  in  the  analysis  (left) 
around  day  7.  It  is  absent  from  the  OPA  simulation  (right).  Evidence  of  a  mesoscale  anticyclonic 
eddy  appears  in  the  analysis  (left)  near  day  50.  The  mesoscale  variability  in  the  OPA  simulation  is 

much  reduced  vs.  the  analysis. 

IMPACTS  AND  APPLICATIONS 

Wikle  and  Milliff  were  invited  speakers  at  a  National  Researeh  Couneil  workshop  on  “Uneertainty 
Management  in  Remote  Sensing  of  Climate  Data”  in  Deeember  2008.  The  BHM-SVW  was  the  topie 
of  Milliff  s  talk. 

Wikle,  Milliff  and  Dr.  Manuel  Fiadeiro  (ONR  Pgm  Mgr)  are  hosting  a  session  on  Probabilistie 
Modelling  in  Oeeanography  at  the  AGU  2010  Ocean  Sciences  Meeting  in  Portland,  OR.  Berliner  and 
Pinardi  are  invited  speakers. 

RELATED  PROJECTS 

NSF-C433P-RFM-CORA- 1433 ; 

"Collaborative  Research:  Estimating  Ecosystem  Model  Uncertainties  in  Pan-Regional  Syntheses  and 
Climate  Change  Impacts  on  Coastal  Domains  of  the  North  Pacific  Ocean".  Co-PIs  include  Wikle  and 
Milliff;  Advisory  Council  includes  Berliner.  Period  of  Performance  September  2008-  August  2011. 

ONR  PO  (in  process): 

“Bayesian  Hierarchical  Model  Characterization  of  Model  Error  in  Ocean  Data  Assimilation  and 
Eorecasts”  Co-PIs  include  Berliner,  Wikle  and  Milliff.  Period  of  Performance  to  be  determined 
(4yrs). 
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